Landmark image annotation using textual and geolocation metadata
نویسندگان
چکیده
In this paper, we address the problem of landmark image annotation, defined as the task of automatically annotating a landmark query image with relevant descriptors (keywords or tags). Given a new query image along with its geolocation metadata (latitude and longitude), we retrieve several other images already available in a community image database (e.g., flickr.com, panoramio.com), found within a fixed radius of the location of the query image. We then formulate the automatic landmark image annotation problem as a tag ranking problem over all the tags obtained from these pre-existing neighboring images. We propose several tag ranking factors, and by evaluating them against a gold standard constructed using the geolocation-oriented photo sharing platform panoramio.com, we show that an aggregated measure that combines both distance and frequency factors leads to results significantly better than any of the individual factors.
منابع مشابه
Tags Re-ranking Using Multi-level Features in Automatic Image Annotation
Automatic image annotation is a process in which computer systems automatically assign the textual tags related with visual content to a query image. In most cases, inappropriate tags generated by the users as well as the images without any tags among the challenges available in this field have a negative effect on the query's result. In this paper, a new method is presented for automatic image...
متن کاملIdentifying the Geographic Location of an Image with a Multimodal Probability Density Function
There is a wide array of online photographic content that is not geotagged. Algorithms for efficient and accurate geographical estimation of an image are needed to geolocate these photos. This paper presents a general model for using both textual metadata and visual features of photos to automatically place them on a world map.
متن کاملImage Annotation System Using Visual and Textual Features
We present an automated Image Annotation system called I-Tag which uses both visual and textual information of the images and recommends relevant tags for them. The automatic generation of metadata would allow image searches and content-based image retrieval (CBIR) to be more effective. We use state of the art tools on text based retrieval and image content based retrieval to retrieve similar i...
متن کاملAutomated Annotation of Landmark Images Using Community Contributed Datasets and Web Resources
A novel solution to the challenge of automatic image annotation is described. Given an image with GPS data of its location of capture, our system returns a semantically-rich annotation comprising tags which both identify the landmark in the image, and provide an interesting fact about it, e.g. “A view of the Eiffel Tower, which was built in 1889 for an international exhibition in Paris”. This e...
متن کاملA Multi-Modal Incompleteness Ontology model (MMIO) to enhance 4 information fusion for image retrieval
A significant effort by researchers has advanced the ability of computers to understand, index and annotate images. This entails automatic domain specific knowledge-base (KB) construction and metadata extraction from visual information and any associated textual information. However, it is challenging to fuse visual and textual information and build a complete domain-specific KB for image annot...
متن کامل